"The highlighted tokens are primarily Japanese grammatical endings, auxiliary verbs, particles, and polite or formal sentence endings. These elements are essential for expressing tense, aspect, negation, modality, and politeness, and for connecting clauses or marking sentence boundaries. They play a crucial role in structuring Japanese sentences and conveying nuanced meaning."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.73 | 1.0 | 0.46 | 0.63 | 0.46 | 1.0 | 0.0 | 0.54 |
fuzz | 0.83 | 1.0 | 0.66 | 0.795 | 0.66 | 1.0 | 0.0 | 0.34 |